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Introduction 


First  we  Impose  the  condition: 


Two  matrix  coefficient  polynomials 

P 

A(z)  =  and  B( 


and  B  ( z )  »  ^  I 

J“0 


(where  A^^,  Bj  are  r  x  r  matrices)  are  said  to  have  no 


common  left  divisors.  If  matrix  coefficient  polynomial 
t 


D(z)  =  ^ 


Is  such  that 


A(z)  s  0(z)A^(z)  and  B(z)  «  D(z)B^(z) 


then  det(0(z))  Is  a  constant 


A  multivariate  stationary  process  X.  =  (X,  (t)  ,X,.(t)  ,  •  •  •  ,X  (t))^ 

L  1  2  r 

Is  said  to  follow  a  multivariate  ARMA  model  If  It  can  be  expressed 
In  the  form 

P  q 

y A.  X.  .  -  yB.c^_.,  t  -  0,  ±  1,  ±  2,---  (1.1) 


y  Vt-k  “  y®j^t-j' t  -  0,  ±  1,  ±  2,*--  (1.1] 

k-0  J*0 

where  -  (Cj(t),  c ^[t) ,• • • ,  t  »  0,  ±  l,  ±  2,***  Is  a 
multivariate  white  noise  process.  I. 

t  t  S  t  .  8 

Aq.Ai , • • • ,Ap,Bo,Bi , • • • ,Bq  are  r  x  r  real  matrices,  A^  =  I . 


Bq  Is  positive  definite  and 


a.  A(z)  «  2,  V 
k«0 

left  divisors. 


Aj^z  and  B  ( z ) 


z-*  have  no  common 


loB  fsr 


b.  det(A(z))  p  0,  |z|  s  1;  det(B(z))  p*  0,  |zj  <  1. 


uiesB 

oatioc 


In  this  case  (X^)  Is  said  to  be  a  multivariate  ARMA  series 


f-, 

ipvaii  aad/or  ‘ - 1 

Spaolal  1 

|£j 

XJ 

series  If  q  «  0  (p»0) . 


Let  B  be  the  backward  shift  operator,  we  can  express  ARMA  model 
(1.1)  In  the  form 

A(B)X^  -  B(B)?^,  t  -  0,  ±1.  ±2.*--  '(1.2) 

One  of  the  basic  problem  associated  with  the  multivariate  ARMA 
models  Is  the  Identification  of  the  structure  of  (1.1),  given  the 
covariance  function  of  (X^),  by  Identification  we  mean  here  the 
following  problem:  given  that  (X^)  conforms  to  some  multi¬ 
variate  ARMA  model  of  unspecified  orders  can  we  determine  the 
values  of  p  and  q  and  the  matrices  A^ , A2 > * ‘ , A^.B^.B^ , *  *  * ,B^ 
uniquely  from  the  covariances  of  (X^)  [1].  In  the  case  of  r  ■  1, 
It  Is  known  that  we  can  determine  the  values  p,q  and 
Ai .Aj/ • • • . Ap,  BQ,B^,***,Bq  uniquely  from  the  covariance  function 
of  (X^).  So  univariate  ARMA  model  Is  Identifiable. 

It  Is  easy  to  see  that  multivariate  ARMA  model  Is  not  Identifiable. 
Suppose  that,  In  model  (1.1),  det(A(z))  and  det(B(z))  are  all 
nonzero  constant,  then  the  following  three  models 

A(B)X^  -  B(B)c^ 

X^  -  A"^(B)B(B)c^ 

B"^(B)A(B)X^  -  t-0,tl,,.2,.  •  . 

have  the  same  stationary  solution. 

In  fact,  corresponding  to  a  given  covariance  structure  of  a  multi¬ 
variate  ARMA  series  there  will  be  an  "equivalent  class"  of  models, 
and  the  problem  of  Ident If lability  then  becomes  one  of  devising  a 


set  of  rules  which  select  a  unique  representative  model  from  each 
equivalent  class.  Without  the  solution  of  this  problem,  It  will 
be  difficult  to  consider  the  estimation  problem  of  multivariate 
ARMA  models.  This  problem  has  been  studied  principally  by 
Hannan  [2,3],  but  so  far  no  result  Is  satlsflable,  because  the  set 
of  rules  given  Is  not  easy  to  verify.  A  reasonable  and  simple 
rule  on  the  unique  representative  model  Is  given  by  this  paper. 


2 .  Basic  Theorems 

A  multivariate  stationary  process  (X^)  Is  said  to  follow  a 
generalized  multivariate  ARMA  model  If  It  can  be  expressed  In  the 
form 


where  c 
process : 
are  r  x 


q 


(2.1) 


k-0  j»0 

«  (€ , ( t ) ,c - ( t ) , • • • ,€^( t) Is  multivariate  white  noise 

X  c  T 

X 

Be .  =  0,  Be  .e^  "6.  _I,  Art,A,,A.,,***,A  , 

V  t  s  c.s  0  12  p  o  1  q 

r  real  matrices.  A^  «  I,  B^  Is  positive  definite. 


Let 


P  q 

A(z)  ■  B^z^. 

k»0  j«0 


Theorem  2 . 1 

If  det(A(z))  00,  |z|*l,  then  model  (2.1)  has  unique 
stationary  solution. 


Proof : 


Let  us  use  the  same  signs  given  by  Rozanov  [4].  Write 


B. 


bj(lc) 

b2(k) 


br(k) 


,  k  -  1 , 2, • • • ,q. 


(2.2) 


define 


«^(b^(k))  -  b^(k)€^  .  1  -  l,2,“*,r 


(2.3) 


Sk(M 


E,.o(bi(k))  ] 
E,.o(b2(k)) 


E,eo(br(>^)) 


.  k  -  0,1,2, 


(2.4) 


Where  is  the  epectral  operator. 

Since  all  the  elements  of  A~^(e~^^)  are  continuous  in  X  e  (•“n,n]. 


We  can  define 
X 


.-ilt.i(t-k)X 


^  ^  I  A"^e  )e-' - -  ds^(X) 


(2.5) 


k-0  -« 


t  ■  0,  ± 1 , 


Where  i  * 


EX^  -  0 


E(X^X^)  -  (X^.X^) 


^  A"^(e"^^)e^^^"''’^dSj^(X) ,  I  A"^(e‘^^)e^^"”^^^dSj(X)j 

k«0  j«0  -n  -n 


q  q 


k«0  j»0  -w 


-n 


: 


I 


It  follows  that  {X^}  Is  a  r-varlate  stationary  procsss  with 


zero  mean ,  and 


P  q 


Ivt-.  - 1 1 1 

k»0  k»0  j*0  -n 


.  Y  f  A-Ne-i^)e^<"-J)^dSj(l) 

j-0  -n  k-0 

J-0  -« 

q 

■  Z  Vt-r 

J-0 

If  (Y^)  is  also  a  stationary  solution  of  model  (2.1),  write 

r  e,y,(o)  I 


MX)  - 


(2.6) 


where  (Y^(t) ,Y2(t) , • 
For  any  t 


E,Yr(0) 


•.Y^(t))‘  -  Y^, 


(X) 

-n  J-0 
P 

J-0 

ZVt-3 

J-0 


-n  j»0 


Let  A 


^(e  ^  ^  be  series  expansion  of  A  ^(e 


ms-oo 


then  every  elements  of  tends  to  zero  by  negative  exponential 

ratio  as  |m|  — >  oo  [5].  So,  It  follows  that 


“  •  t*0,±l,±2,***. 

Corollary  2.1.  If  det(A(z))  ^  0,  ]z|»l,  the  unique  stationary 
solution  of  (2.1)  is  In  the  form 


t  2L.  m  t-m 


(2.8) 


m=-<3D 


where  are  r  x  r  real  matrices  determined  by 


A  ^(z)B(z)  ■  ^ 


(2.9) 


with  r^  <  1,  r^  >  1 . 


Proof:  Suppose  that  A  (z)  “  according 


m»-<» 


to  (2.9). 


Since 


‘m  “ 


(2.10) 


A(z) 


V  z  -  I 


(2.11) 


m—® 


Every  elements  of  tends  to  zero  by  negative  exponential 

ratio,  so  does  that  of  A^,  as  |a|  — ►  ®,  and  It  follows  that 
{X^}  given  by  (2.8)  Is  a  stationary  process  with  zero  seen,  and 

P  p  ® 

X^h*t-k  “  X  ^«*^t-k-a 

k*0  k»0  m"-® 


P  00 

q 

1 

M 

M 

Zvi* 

t-k-m 

k«o  m“-® 

J-o 

P  OD 

q 

•z*.z 

Z''.-k- 

J®j^t-n 

k«o  m«-® 

J-o 

q  ®  r  P 

III 


j«o  m*-® 


k-0 


A  V 

^k''a-k-J 


®j'^t“a 


q 

X®/t-J  • 


J-0 


Corollary  2.2.  If  det(A(z))  p  0,  when  |z|»l,  then 

a.  the  unique  stationary  solution  of  (2.1)  Is  In  the  fora 

» 

a«0 

If  and  only  If  every  elements  of  A~^(z)B(z)  Is 


holoaorphlc  function  of  z  In  the  field  of  (z.|z|<l). 
If  det(A(z))  and  det  (B(z))  have  no  common  divisor. 


the  condition  Is  equivalent  to  that  all  the  roots  of 
det(A(z))  are  outside  the  unit  circle. 


b.  the  unique  stationary  solution  of  (2.1)  Is  In  the  fora 

M 

M— <0 

—  1 

If  and  only  If  every  eleaents  of  z  A  (z)B(z)  Is 
holoaorphlc  function  of  z  In  the  field  of  (z,|z|^l 
including  the  infinite  point).  If  det(A(z))  and 
det(B(z))  have  no  coaaon  divisors,  the  condition  Is 
equivalent  to  that  all  roote  of  det(A(z))  are 
Inside  the  unit  circle. 

c.  the  unique  etatlonary  solution  of  (2.1)  Is  In  the  fora 

CD 

B*-<» 

If  and  only  If  all  the  eleaents  of  A~^(z)B(z)  are 
holoaorphlc  functions  of  z  In  the  field  of 
(z, r^s I z| s r^ )  where  rj<l.r2>l>  If  det(A(z))  and 
det  (B(z))  have  no  coaaon  divisors,  the  condition  is 
equivalent  to  that  all  roots  of  det(A(z))  scatter  both 
outside  and  Inside  the  unit  circle. 

(The  proof  Is  erased,  because  It  Is  a  problea  of 
algebra) 

Corollary  2.3  Under  the  saae  condition  of  Theorem  2.1,  aodel 


(2.1) 


and  aodel 


t«0,* 1 ,±  2  ,  • •  • 


(2.16) 


lc=0  J=0 


(where  .♦o* ***  »*«-  **■«  r  x  r  real  matrices. 

0  1  8  1  4  T 

S 

♦  q=I,  Is  positive  definite,  det f  0,  |2|“1) 


k»0 


have  same  stationary  solution  If  and  only  If 


A  ^{2)B(Z)  =  ♦  ^(z)*(z),  |z|si 


(2.17) 


where 


♦  (z) 


♦  *(2) 


k»0 


Iv^ 

j-0 


Proof  Is  erased. 


Theorem  2.2  If  multivariate  stationary  process  (X^)  follows 


multivariate  ARMA  model  (1.1),  then  the  white  noise  process 

.T 


(e^)  Is  the  Innovation  process  of  (X^)  [6],  and  BqBq  Is 
the  one  step  prediction  error  matrix,  l.e. 

1/2 


B, 


|(X^  -  P*'oJH^(t-l)*t'*t  "  *’*^°^Hj^(t-l)*t} 
[Xt  “  (t-l)*t] 


B 


(2.18) 

(2.19) 


where  H^(t-l)  Is  the  Hilbert  space  extended  by  (*^-1 


‘■t-2' 


Proof:  A(z)  Is  holomorphlc  Inside  the  unit  circle,  the 


stationary  solution  of  (1.1)  Is  In  the  form 

OD 

X. 

m«0  -n 


10 


» 


f 


y- 

•i 


la 


§ 


.4! 


■ti.  .tl.  >.t  «.«  I? 


TVD^  rwiiwcn^jii^rv' JWT  n»^  r 


r  -1  -lA  -1  -i\  itA  , 

j  A  Ne  "  )B  (e  )s 


/»  V  X  If  .-1/  xo/  -i^x,*-l/  -i^xo/  -i^xx*  l(t-8)A 

(X^,X^)  =  2^J  A  (e  )B(e  ) (A  (e  )B(e  ))  - 


where  A  denotes  the  conjugate  transpose  matrix  of  A.  It 


follows  that  the  spectral  density  matrix  function  of  {X^}  is 


f(^)  =  A  ^e  ^^)B(e"^^)(A  ^  (e"^^  )B(e"^^  )  )  * 


(2.20) 


Let  C(e"^^)  =  A~^(e  ^^)B(e~^^)  =  Va 

m 


-Im 

e 


(2.21) 


* ,  be  the  Wold  coefficient  matrices  of  {X^}  and 


r(z)  =  Uhl 

J*0 


(2.22) 


then 


f(A)  »  r(e‘^^)r*{e"^S  .  [6] 


(2.23) 


Now  what  we  need  to  do  Is  to  prove  C(z)  »  r(z).  According  to 


(2.21),  (2.23)  and  [6],  we  only  need  to  prove 


r(0)r*(0)  =  C(0)C*(0) 


(2.24) 


Since 


r(o)r*(o)  2  c(0)c*(0)^®^ 


(2.25) 


det(C(z)),  det(r(z))  are  all  the  maximum  function  In  the  H. 


space  [7.8]  with  the  same  boundary  value  on  the  unit  circle,  so 


det(r (0)r*(0)  «  det(C(0)C*(0) 


(2.26) 


If  V  Is  an  Invertible  matrix  such  that 


vr(o)r*(o)v*  =12  vc(o)c*(o)v* 


(2.27) 


CS»'WWi»T*.K».*  *.« 


3: 


and  U  is  a  unitary  matrix  such  that 


I  »  UU*  2  UVC(0)C*(0)V*U* 


(2.28) 


we  know  0  a  \ ^  i  1,  according  to  (2.26),  we  have  ^i^2***^r  " 


and  X.  '  therefore 


r(o)r*(o)  =  c(0)c*(0) 


It  follows  that 


C(z)  »  r(z),  |z|  s  1. 

Let  {?  )  be  the  innovation  process  of  (X.  }  with  E?  ■  I 
n  t  n  n 


00 


00 


’‘t  -  IVt-J  -  Z*3't-3 

j=0  J-C 

be  the  Wold  decomposition  of  (X^),  using  c^±H^(t-l), 
j;t*AQ^(Xt-ProjH  (t-i)*t^'  follows  that 


and  therefore 


Because 


c^-  »  t=0,±  1  ,± 2 ,  •  ♦  •  . 

2  T 

^0  ~  ^0  ”  ^0*  ^0^0  *  ^0^0 


Corollary  2.4.  Let  stationary  series  X^»(Xj(t) ,X2(t) , • • • ,X^(t) ) 
follows  multivariate  ARMA  model  (1.1),  stationary  series 


y^  ■  (Y(t)  ,Y2(  t)«  •  •  ,Yj.(t) )  follows  multivariate  ARMA  modal 

s  f 

^  ♦  Y  «  ^  ♦  r. 

^'k  t-k  ^  *  J  t-j 
k-0  j»0 


(2.29) 


then 


E 


(X^X  )  »E(Y.Y  ),  for  all  t,o-0,±l,±2,*** 
t  s  t  s 


a 


% 


s 


1  o 


If  and  only  If 


a"^(z)B(2)  -  ♦  ^(z)f(z)  |z|sl  (2.30)  ' 

a  t 

where  #(z)  -  *(2)  =  * 

J-0  k-O  I 

I 

Proof:  If  a"^(z)B(z)  -♦"^(z)t(z),  then  (X^),  {Y^>  have  the  | 

sane  spectral  density  matrix  function  (2.20),  and  therefore, 

{X^},{Y^}  have  the  same  covariance  structure. 

If  (X^),  (Y^)  have  same  covariance  structure,  they 
have  same  Wold  coefficients  matrices  C^,C^ ,02# *  *  * ,  and  so 

OD 

A'^Z)B(Z)  »  ♦■^z)f(z)  «  r(z)  -  ^CjZ^,  Iz^i. 

J-0 

3.  Identlf lability  of  Multivariate  ARMA  models 

Theorem  3.1  Asstune  stationary  series  X^  «  (X, (t) ,X„(t) , • • • ,X„(t)^ 

viz  V 

follows  multivariate  ARMA  model  (1.2)  and  where  det(A(z}) 
and  det(B(z))  have  no  common  divisors,  then  If 

det(Ap)  0  0  (or  det(Bq)i*0)  (3.1) 

We  can  determine  the  values  of  p,  q  and  the  matrices 

^O’^l  ’  *  *  ’ '^p'®0'®l '  *  *  * '®q  from  the  covariance 

structure  of  (X^). 

Proof:  Assume  that  X^  follows  another  multivariate  ARMA  model 

s  t 

-  Z*/t-3 

J-0  3-0 

with  det(f(z))  and  det(t(z))  have  no  common  divisors  and 


iwMi^ 


det(*  )  I'  0  (or  det(f.)  f  0). 
s  •t 


Using  Corollary  2.4,  we  have 


a"^(z)B(2)  -  ♦“^(2)t(2)  ,  Izjsl 


(3.3) 


Let  A(z)  and  B(z)  be  the  adjoint  matrices  of  A(z)  and 
B(z)  respectively  then  we  have 

♦(z)A(z)  -  ♦(z)B(z)  |z|sl 

where  b(z)  =  det(B(z)),  a(z)  «  det(A(z)).  Since  a(z),b(z) 
have  no  common  divisor.  It  follows  that 


a(z) 


♦(z)A(z)  »  D(z) 


must  be  a  matrix  coefficient  polynomial  and 

♦(z)  »  D(z)A(z)  |2|sl 


♦(z)  -  D(z)B(z) 


(3.4) 


(3.5) 


Note,  4(z),  i(z)  have  no  common  left  divisor,  so 


det(D(z))  =  constant < 


Write  D(z) 


^  then  det(Djjj)  =0,  if  mil. 


Using  (3.4),  det(4_)^0,  det(A  )  0,  (or  using  (3.5), 

s  p 

det(tj),  det(Bq)»*0),  we  have  m«0,  so 


Prom  *0  “ 


D(z)  <■  Dq  Is  a  constant  matrix. 
“  I,  wo  have  *=  I,  therefore 
♦ (z)  -  A(z) ,  ♦ (z)  «  B(z) . 


A  familiar  result  about  multivariate  AR.MA  model  follows 
directly  from  Theorem  3.1.  Multivariate  AR.MA  model  are  all 
Identifiable . 


Definition: 


A  stationary  series  X.  ■  (X,  (t)  ,X-(t) ,  •  •  •  ,X  (t))’^  is 
said  to  follow  a  multivariate  ARMA(LC)  model,  if  it  can  be 
expressed  in  the  form 

k  q 

Zvt-k '  Zvt-j 

k=0  J»0 

where 

m)  c.  =  (€ , (t) ,e -(t) • ,c  (t))^  is  a  multivariate 

T  1  2  It 

white  noise  process.  Ec.  «  0,  Ec.c^  »  6  .1. 

t  t  s  s .  t 

p 

b)  a^,a2,***,ap  are  real  constant.  *o“^ '  ^  aj2^«-0, 

j-0 

for  Izl^l.  B. ,B. are  r  x  r  real  matrices.  B.  is 
■  ■  o  1  u 

positive  definite,  det(B(z))  *•  0.  |z|<l. 

q 

B(k)  - 

>1 

c)  The  set  of  polynomials  (a(z) ,b^^(z) , 1 .k^l . 2* • • r > 
have  no  common  divisors. 

It  can  be  seen  that  the  values  of  multivariate  AfU4A(LC) 
models  are  not  more  complex  than  that  of  multivariate  ARMA  models. 
But  we  can  prove  the  following  result. 

Theorem  3.2  1.  Any  multivariate  stationary  series  that  follows 

some  multivariate  ARMA  model  will  follow  some  multivariate 
ARMA(LC)  model. 

2.  Multivariate  ARMA(LC)  model  is  identifiable. 

Proof  1.  Assume  that  X^  follows  multivariate  ARMA  model  (1.2). 

Let  a(z)  -  det(A(z)),  B  (z)  •  A(z)B(z)  • 

1  ij  rxr 


where 


A(z)  Is  ths  adjoint  matrix  of  A(z).  Using  Corollary  2.3  ws 
havs  that  can  bs  sxprssssd  In  the  form 

a(B)X^  -  (3.7) 

where  B  Is  the  backward  shift  operator. 


Assume  f(z)  Is  the  maximum  divisor  of 


then 


(a(z).  d^j(z);  1, j-1 , 2, • • • ,r) 


i(z)  -  aj(z)f(z) 


djj(z)  «  C^j(z)f(z)  l,J»l,***,r 


and 


(a^(z).  c^j(z):  1 , j*l , 2 , *  *  * , r)  have  no  common  divisors 


Let 


C(z)  .  (C,j(z))^^^ 


It  follows  that  X^  follows  ARMA(LC)  model 


aj(B)X^  -  C(B)c^ 


Assume  X^  Is  a  multivariate  stationary  series  that 
follows  ARMA(LC)  model 


a(B)X^  -  B(B)c^ 


and 


♦  (B)X^  -  t(B)J;^  . 


According  to  Corollary  2.4 


a“^(z)B(z)  -  #‘^(z)#(z) .  |z|il 


(3.8) 


so 


#(z)B(z)  «>a(z)*(z),  |zhl 


(3.8) 


Assume  g(z)  Is  the  maximum  divisor  of  the  polynomials  a(z) 
and  #  ( z ) ,  and 


#(z)  •  g(z)4, (z) 


a(z)  *  g(z)a^(z),  g(0)  »1 


(3.9) 


than,  #j(z)B(z)  •  a^(z)f(z) 

and  ^^(z)  la  a  couion  divisor  of  the  set  of  polynomials  of 
t(z).  Therefore 

B(z)  -  aj(z)  *  *1<*>*1<*> 

From  (3.9),  we  see 

a^(z)  -  1,  and  ^^(z)  -  1  all  the  same, 

therefore 

a(z)  -  #(z) 

B(z)  -  ♦(z) 

This  paper  was  written  during  the  stochastic  process  seminar 
in  the  department  of  mathematics,  Peking  University.  I  would  like 
to  thank  ay  teach  professor  Ching  Tse-Pei,  colleagues  and  friends 
who  helped  me  during  this  seminar. 


References 


[1]  Priestley,  M.B.,  Spectral  Analysis  And  Time  Series.  Acadealc, 
Long,  New  York  (1981) 

[2]  Hannan,  E.J.,  The  Identification  And  Paraaeterlsatlon  of 
ARMAX  And  State  Space  Forms.  Bconometrlca,  44,  713-723(1976) 

[3]  Hannan,  E.J.  and  B.G.  Qulnu,  The  Determination  of  the  Order 
of  An  Autoregression.  J.R.  Statist. Soc.B. 41 ,  190-199(1979). 

[4]  Rozanov,  Yu. A.,  Spectral  Theory  of  Multi -dimensional 
Stationary  Random  Processes  with  Discrete  Time.  Uspehl  Mat. 
Na\xk  13,2(80),  93-142(1958). 

[5]  Hannan,  E.J.,  Multiple  Time  Series,  Wiley,  New  York  (1970). 

[6]  Rozazov,  Yu. A.,  Stationary  Random  Processes.  (Translated  by 
A.Pelnsteln)  (1967). 

[7]  Wiener,  N.  and  Masanl,  P.,  the  Prediction  theory  of  Multi¬ 
variate  Stochastic  Process,  I.  Acta. Math. 28( 1957 ) . 

[8]  Prlvalov,  I. I.,  Boundary  Properties  of  Analytic  Functions. 
Moscow-Lenlngard  (1950). 


F 


